This dashboard compares coaching bot versions based on session metrics, annotations, and user engagement.
Generated: 2025-11-10 15:07:32
| Coaching Bot Version | # Sessions | # Annotated Sessions | Refrigeration Examples (%) | Median Human Words per Session | Average Session Rating |
|---|---|---|---|---|---|
| Control bot | 4231 | 0 | 0.0% | 37.0 | 4.80 |
| Coaching bot V3 | 888 | 80 | 0.0% | 124.0 | 4.71 |
| Coaching bot V4 | 949 | 172 | 33.1% | 105.0 | 4.85 |
| Coaching bot V5 | 1291 | 62 | 37.1% | 152.0 | 4.53 |
| Coaching bot V6 | 2168 | 10 | 70.0% | 120.5 | 4.65 |
| Total (All Versions) | 9527 | 324 | 26.5% | 120.5 | 4.71 |
| Category | # Sessions | # Annotated Sessions | Refrigeration Examples (%) | Median Human Words per Session | Average Session Rating |
|---|---|---|---|---|---|
| All Versions | 9527 | 324 | 26.5% | 120.5 | 4.71 |
| Refrigerator Example Sessions Only | 87 | 87 | 100.0% | 154.0 | 4.81 |
| Method | Control bot | Coaching bot V3 | Coaching bot V4 | Coaching bot V5 | Coaching bot V6 | All Versions |
|---|---|---|---|---|---|---|
| Scenario | - | - | 100.0% | 100.0% | - | 100.0% |
| Microlearning | - | - | 72.3% | 100.0% | - | 86.2% |
| Microlearning vaccines | - | - | - | 66.7% | 100.0% | 83.3% |
| Motivational interviewing | - | - | 62.5% | 100.0% | 100.0% | 87.5% |
| Visit check in | - | - | 100.0% | 100.0% | - | 100.0% |
| Unknown | - | - | - | - | - | - |
| Total (All Methods) | - | - | 83.7% | 93.3% | 100.0% | 91.4% |
| Method | Control bot | Coaching bot V3 | Coaching bot V4 | Coaching bot V5 | Coaching bot V6 | All Versions |
|---|---|---|---|---|---|---|
| Scenario | - | 4.77 | 4.77 | 4.46 | 4.63 | 4.66 |
| Microlearning | - | - | 4.85 | 4.55 | 4.63 | 4.68 |
| Microlearning vaccines | - | - | - | 4.47 | 4.65 | 4.56 |
| Motivational interviewing | - | - | 4.87 | 4.69 | 4.67 | 4.74 |
| Visit check in | - | 4.63 | 4.94 | 4.64 | 4.66 | 4.72 |
| Unknown | 4.80 | - | - | - | 4.86 | 4.83 |
| Total (All Methods) | 4.80 | 4.70 | 4.86 | 4.56 | 4.68 | 4.70 |
| Method | Control bot | Coaching bot V3 | Coaching bot V4 | Coaching bot V5 | Coaching bot V6 | All Versions |
|---|---|---|---|---|---|---|
| Scenario | - | 12.0 | 11.0 | 14.0 | 12.0 | 12.0 |
| Microlearning | - | - | 13.0 | 14.5 | 13.0 | 13.0 |
| Microlearning vaccines | - | - | - | 13.0 | 13.0 | 13.0 |
| Motivational interviewing | - | - | 16.0 | 19.0 | 17.0 | 17.0 |
| Visit check in | - | 13.0 | 15.0 | 18.0 | 17.0 | 16.0 |
| Unknown | 9.0 | 3.0 | 3.0 | - | 12.0 | 6.0 |
| Total (All Methods) | 9.0 | 12.0 | 13.0 | 14.5 | 13.0 | 13.0 |
| Method | Control bot | Coaching bot V3 | Coaching bot V4 | Coaching bot V5 | Coaching bot V6 | All Versions |
|---|---|---|---|---|---|---|
| Scenario | - | 127.0 | 100.0 | 151.0 | 127.0 | 127.0 |
| Microlearning | - | - | 87.0 | 122.0 | 90.0 | 90.0 |
| Microlearning vaccines | - | - | - | 93.5 | 90.0 | 91.8 |
| Motivational interviewing | - | - | 108.0 | 167.5 | 127.0 | 127.0 |
| Visit check in | - | 118.5 | 130.0 | 209.5 | 169.5 | 149.8 |
| Unknown | 37.0 | 8.0 | 13.0 | - | 54.0 | 25.0 |
| Total (All Methods) | 37.0 | 118.5 | 100.0 | 151.0 | 108.5 | 109.4 |
| Method | Control bot | Coaching bot V3 | Coaching bot V4 | Coaching bot V5 | Coaching bot V6 | All Versions |
|---|---|---|---|---|---|---|
| Scenario | 1 | 637 | 258 | 553 | 447 | 1896 |
| Microlearning | - | - | 247 | 186 | 412 | 845 |
| Microlearning vaccines | - | - | - | 176 | 410 | 586 |
| Motivational interviewing | - | - | 219 | 190 | 437 | 846 |
| Visit check in | 6 | 242 | 219 | 186 | 448 | 1101 |
| Unknown | 4224 | 9 | 6 | - | 14 | 4253 |
| Total (All Methods) | 4231 | 888 | 949 | 1291 | 2168 | 9527 |
This dashboard compares five bot categories based on experiment IDs and version ranges:
Coaching methods are detected through a 3-tier approach:
This metric shows the average session rating (1-5 scale) grouped by coaching method and bot version.
This metric shows the median number of messages participants send per session, grouped by coaching method and bot version.
This metric shows the median number of words users type per session, grouped by coaching method and bot version.
For line graph analysis, sessions are numbered chronologically per participant: